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(54) Audio/video recording apparatus and method of multiplexing audio/video data 



(57) An audio/video recording apparatus and a 
method of multiplexing audio/video data of a first input 
memory with supplementary data of a second input 
memory wherein a DMA processor is provided with a 
link list for the audio/video data and the supplementary 



data, an output memory is provided with instructions to 
receive a data amount equal to the combination of au- 
dio/video data and supplementary data and the DMA 
processor is instructed to carry out a DMA process to 
the output memory on the basis of the link list. 
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Description 

[0001] The present invention relates to an audio/video 
recording apparatus and a method of multiplexing au- 
dio/video data, in particular, when recording audio/video 5 
data in a memory, such as a recording medium, together 
with supplementary data. 

[0002] In order to record supplementary data along 
with audio/video streaming data on a digital storage me- 
dium, it Is known to multiplex the audloMdeo data with io 
the additional information in a memory before then 
transferring the multiplexed data to the recording medi- 
um as a whole. This is illustrated schematically in Figure 
1 of the accompanying drawings. A single DMA process 
is used to transfer the multiplexed data from the memory '5 
to the recording medium so as to provide it as a whole 
to the recording medium. However, a number of individ- 
ual DMA processes are required to transfer the sections 
of audio/video data and supplementary data to the in- 
termediary memory. 20 
[0003] Alternatively, the supplementary data can be 
recorded on the recording medium at a later time and at 
a different place to the main audio/video data. This is 
illustrated schematically in Figure 2 of the accompany- 
ing drawings. 25 
[0004] Both methods require system resources. In the 
case of multiplexing the data to an intermediary memory 
first, the system requires the system resources to do the 
multiplexing and the additional memory in which the 
multiplexed data is stored before transfer to the record- 30 
ing medium. On the other hand, when the supplemen- 
tary data is stored at a different place on the storage 
medium to the audio/video data, the bandwidth to the 
storage medium is reduced, especially if the storage 
medium has a large seek time, for instance to move a 35 
mechanical read/write head to a new location. 
[0005] This is particularly applicable to recording de- 
vices which record an input stream of audio/video data : 
together with supplementary data received with the au- 
dioMdeo data. A log of the supplementary data may be *o 
kept as the input audio/video data is received. It is pos- 
sible to record the log after all of the audio/video data 
has been recorded on the recording medium. However, 
this makes reproduction undesirable, since, to repro- 
duce the audio/video data together with the supplemen- 45 
tary data, the reproduction device has to access differ- 
ent positions of the recording medium which are spaced 
widely apart. It is desirable, therefore : to interlace or 
multiplex the information from the log in with the audio/ 
video data stored on the recording medium. As ex- 50 
plained above, this was previously achieved by multi- 
plexing the data in a separate memory before transfer 
to the recording medium. 

[0006] It is an object of the invention to allow the prob- 
lems discussed above to be overcome and to allow mul- 55 
tiplexing of two or more data streams/sources. 
[0007] According to the present invention, there is 
provided a method of multiplexing audio/video data of a 
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first input memory with supplementary data of a second 
input memory using a DMA processor, the method in- 
cluding: 

providing the DMA processor with a link list for the 
audio/video data and the supplementary data; 
providing an output memory with instructions to re- 
ceive a data amount equal to the combination of au- 
dioA/ideo data and supplementary data; and 
instructing the DMA processor to carry out a DMA 
process to the output memory on the basis of the 
link list. 

[0008] According to the present invention, there is 
provided an audio/video recording apparatus including: 

a first input memory for storing audioA/ideo data; 
a second input memory for storing supplementary 
data; 

an output memory; 

a DMA processor connected between the first and 
second input memories and the output memory; 
and 

a controller for initiating a DMA process by instruct- 
ing the output memory to receive a data amount 
equal to a sum of the audioArideo data and the sup- 
plementary data and by providing the DMA proces- 
sor with a link list so as to transfer the audioArideo 
data and supplementary data to the output memory 
according to the link list. 

[0009] In this way the audioArideo data and the sup- 
plementary data may be transferred and multiplexed in 
one step to an output memory, such as a recording me- 
dium. 

[0010] The invention allows the freeing of system re- 
sources from the task of multiplexing two or more data 
streams. The task of multiplexing is done automatically 
by setting up an appropriate chain of DMA transfers 
wherein each list in the chain causes DMA transfer of 
data from a different point in the apparatus source mem- 
ory (first and second input memories) to the recording 
output memory or medium. 

[0011] Since normal operation would already require 
a DMA transfer to the output or recording memory, there 
is no additional system resources needed for the oper- 
ation. 

[001 2] In practice, the input memories may be includ- 
ed in the same physical memory, such as a chip : for in- 
stance as separate areas. 

[0013] Preferably, the supplementary data includes 
index data for the audioA/ideo data. 
[001 4] The index data is received with the audioA/ideo 
data, tor instance in MPEG packets, and relates directly 
to the audio/video data with which it is carried. Thus, it 
is important that the index data be recorded in a manner 
such that it can be retrieved together with the related 
audioMdeo data. 
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[0015] Hence, multiplexing Ihis data in the manner of 
the present invention for recording on a recording me- 
dium is highly advantageous. 

[0016] Preferably, the apparatus further includes an 
input for an MPEG stream containing the audio/video 
data and index data and includes means for parsing the 
MPEG stream and for storing the audio/video data In the 
first memory and the supplementary data in the second 
memory. 

[0017] In this way, the apparatus can be used to 
record an input MPEG stream. 

[0018] Preferably, the apparatus further includes at 
least one interrupt for causing the controller to initiate 
the DMA process when either of the first and second 
input memories contain a respective predetermined 
amount of data. 

[001 9] In this way. the apparatus receives a stream of 
input data on a continuous basis, but, when either of the 
first and second memories contains a predetermined 
amount of data, for instance is full, the DMA process 
transfers the audio/video data and supplementary data 
to the output memory, for instance the recording medi- 
um. 

[0020] In this way, the audio/video data and supple- 
mentary data may be recorded in alternate interlaced 
sections of the recording medium so as to record a con- 
tinuous input stream. 

[0021] Preferably, the supplementary data includes 
meta data for the audio/video data. 
[0022] The meta data may be any data relating gen- 
erally to the content of the audioMdeo data, for instance 
sub titles, supplementary information about the content 
of the audio/video data, supplementary audio data, etc. 
[0023] Preferably, the apparatus further includes a 
third input memory for storing application data for appli- 
cations related to the audio/video data wherein the con- 
troller initiates the DMA process by instructing the output 
memory to receive a data amount equal to a sum of the 
audio/video data, the supplementary data and at least 
a portion of the application data and by providing the 
DMA processor with a link list so as to transf erthe audio/ 
video data, supplementary data and the at least a por- 
tion of the application data to the output memory accord- 
ing to the link list. 

[0024] The application data may be any data for use 
in relation to the audio/video data. It may be received 
from the same data path as the audio/video data, but at 
a different time or on a different channel. Alternatively 
the application data might be received from a different 
data path, such as via the internet. 
[0025] By multiplexing this application data with the 
audio/video data for recording on the recording medium, 
the application data is available to a user immediately 
when reproducing the audio/video data. It this way : 
whatever application is provided by the application data 
will be available to the user at the time of reproduction 
of the audio/video data. 

[0026] Preferably, each time the controller initiates the 



DMA process, the controller instructs the output mem- 
ory and provides a link list In respect of a different portion 
of the application data such that the application data is 
multiplexed with consecutive amounts of audio/video 
5 and supplementary data from the first and second mem- 
ories. 

[0027] In this way, the application data can be spread 
in an interlaced fashion with consecutive blocks of au- 
dio/video and supplementary data. This reduces the ex- 

io tent to which the insertion of the application data affects 
seek times for the audio/video data. 
[0028] The output memory may have large seek 
times, but fast continuous access times. 
[0029] In this respect, the output memory may be a 

is hard disk drive. 

[0030] The present invention is particularly advanta- 
geous in this respect, since it allows related data to be 
provided together on a recording medium and avoids 
the need for the output memory to seek data. 

20 [0031 ] The present invention is particularly applicable 
when embodied in an integrated television device, a set 
top box for a television or a stand alone video recorder. 
[0032] The invention will be more clearly understood 
from the following description, given by way of example 

25 only, with reference to the accompanying drawings, in 
which: 

Figure 1 illustrates schematically a process of mul- 
tiplexing data in a memory; 
30 Figure 2 illustrates schematically recording supple- 
mentary data separately to audio/video data on a 
recording medium; 

Figure 3 illustrates an embodiment of the present 
invention; 

35 Figure 4 illustrates an alternative embodiment of the 
present invention; 

Figure 5 illustrates schematically multiplexing of da- 
ta according to the present invention; 
Figure 6 illustrates schematically the list DMA proc- 
40 ess of the present invention; and 

Figures 7(a) to (c) illustrate embodiments of the 
present invention. 

[0033] In most devices that record audio/video 
45 streaming data on to a digital storage medium, the re- 
cording device also adds some sort of index or meta da- 
ta which is related to the audio/video data being record- 
ed. Hence : this additional information needs also to be 
stored on the storage medium. Additionally, there are 
so times when another stream needs to be multiplexed into 
the main audio/video stream to create a new multiplexed 
stream. 

[0034] In a first embodiment of the present invention, 
as illustrated in Figure 3, an input data stream is re- 
55 ceived by a filter 2 to separate from the data stream the 
desired channel. Thus, typically, the input data stream 
will be an MPEG data stream containing data packets 
for different channels. Filter 2 acquires the appropriate 
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data packets and provides this data to the further parts 
of the apparatus. 

[0035] The audio/video data is stored consecutively 
in a first memory 4. This may be a cache memory and 
is labelled cache A. 

[0036] Along with the audio/video data, digital audio/ 
video data streams include supplementary data, such 
as index data. In particular, the index data provides in- 
dexing information regarding the audio/video data, for 
instance time and frame codes, etc. 
[0037] As illustrated, a parser 6 processes the data 
stream output from the filter 2 so as to extract any sup- 
plementary data on an ongoing basis. This supplemen- 
tary data is stored in a second memory 8. This may be 
a cache memory and is labelled cache B. This process 
avoids the need of subsequently analysing the data 
stream in order to determine the supplementary data. 
[0038] The apparatus then includes a DMA processor 
10 which is controlled by a host processor 14 so as to 
transfer data to an output memory 12, such as the re- 
cording medium illustrated in Figure 3. 
[0039] According to previous techniques as dis- 
cussed above, the apparatus could store the entire au- 
dioArideo sequence required by the user in memory 4 
and store all of the related index or supplementary data 
in cache 8. As illustrated by Figure 2, a DMA process 
could be used to transfer the entire audio/video stream 
to a recording medium and, once this is completed, a 
further DMA process could be used to transfer the entire 
supplementary data to a further portion of the recording 
medium. Alternatively, in order to interlace various por- 
tions of the audioArideo data stream and the supplemen- 
tary data, multiple DMA processes could transfer alter- 
nately portions, as illustrated by Figure 1 , from the au- 
dio/video data and the supplementary data to a third 
memory and then use a single DMA process to transfer 
the data from that memory to the recording medium. 
[0040] In contrast, in the illustrated embodiment, data 
from the memories 4 and 8 is transferred via a chained 
list DMA. This is illustrated schematically in Figure 5. 
[0041] By way of explanation, a chained DMA list con- 
sists of a number of individual DMA requests. Each DMA 
request is executed one after the other in the order in 
which they are set. Each DMA request has an independ- 
ent start and length with regard to the source memory. 
In other words, each DMA request has an individually 
set start address and independently set length of data 
for transfer. 

[0042] The output memory 1 2 is instructed by the host 
14 to write any received data starting at a particular ad- 
dress on the recording medium and is also instructed 
with a length which is the total length of all of the indi- 
vidual DMA requests. In this way, the chaining of the 
DMA request is invisible to the recording medium 12. 
The recording medium 1 2 sees this operation as a single 
DMA operation since the chaining of the list is hidden 
from the recording medium 12. 

[0043] Figure 6 illustrates schematically the results of 



the list DMA transferring data from different sources, or 
different parts of a source, to a destination, such as the 
recording medium of output memory 12. 
[0044] In order for the apparatus to operate on a con- 
5 tinuous basis, i.e. recording audio/video data of the in- 
put data stream on to the recording medium of the output 
memory 12, the preferred embodiment includes an in- 
terrupt or trigger 1 6. 

[0045] When memory 4 contains a predetermined 
to amount of data, the Interrupt or trigger 16 causes the 
host 14 to initiate the DMA process. 
[0046] At that time, the host 1 4 instructs the DMA 1 0 
with the start addresses and data lengths for the data in 
the memory 4 and memory 8 and also instructs the out- 
's put memory 12 with the total amount of data to be re- 
corded. The DMA 10 then conducts the chained DMA 
process so as to transfer the audioArideo data from 
memory 4 and the supplementary data from memory 8. 
When the memory 4 again contains the predetermined 
20 amount of data, the interrupt or trigger 1 6 interrupts the 
host 14 so as to initiate the process once more. 
[0047] In most cases, it is expected that the memory 
4 containing the audio/video data will fill long before the 
memory 8. However, it is also possible to provide an ad- 
25 ditional interrupt or trigger connected to the memory 8 
such that, if this memory reaches a predetermined 
amount of data, the host 14 is triggered to initiate the 
DMA process. 

[0048] Figure 4 illustrates an alternative embodiment 

30 including : additionally, a memory 18. In practice, of 
course, the memories 4, 8 and 18 may be separate ar- 
eas of the same physical source memory, such as a sin- 
gle chip, and, hence, the embodiments of Figures 3 and 
4 could operate in the same apparatus. 

35 [0049] The memory 18 is intended for storing addi- 
tional data, such as application data. 
[0050] Some audioA/ideo programs are provided with 
related applications, for instance games, for the user to 
operate in conjunction with the audio/video program. 

40 Hence, it is desirable that, when the audioArideo data is 
recorded on the recording medium, the application data 
is also recorded. In the same way as discussed above, 
the application data could be stored separately on the 
recording medium of the output memory 12. However, 

45 when reproducing the data from the recording medium, 
this may result in large delays as the apparatus seeks 
data for the stored application. Thus, it is proposed that 
the host 1 4 causes the DMA 1 0 to store at least portions 
of the application data in the memory 18 together with 

50 the audio/video data and supplementary data. 

[0051 ] Where, as described above, the apparatus op- 
erates on a continuous basis using the trigger 1 6 to store 
consecutively amounts of audio/video data and supple- 
mentary data, the host 14 instructs the DMA 10 with re- 

55 gard to consecutive portions of the application data in 
the memory 18. In this way, the application data as a 
whole is divided into portions which are interlaced with 
the audio/video data and supplementary data on the re- 
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cording medium 12. 

[0052] The application data can come from any ap- 
propriate source. For example, it could be downloaded 
from the Internet or received from the input stream of 
data, for instance from a different channel. 
[0053] Since the present invention allows the combi- 
nation of two or more different memory locations on to 
one continuous data stream on a recording medium, it 
is particularly appropriate for use with a recording me- 
dium having large seek times, but fast continuous ac- 
cess times. Thus, it may be used with a recording me- 
dium such as a hard disk drive or even tape. 
[0054] Such devices may be embodied in integrated 
televisions such as illustrated in Figure 7(a), set top box- 
es as illustrated in Figure 7(b) or stand alone audio/vid- 
eo recorders as illustrated in Figure 7(c). 



Claims 

1. An audio/video recording apparatus including: 

a first input memory for storing audio/video da- 
ta; 

a second input memory for storing supplemen- 
tary data; 
an output memory; 

a DMA processor connected between the first 
and second input memories and the output 
memory; and 

a controller for initiating a DMA process by in- 
structing the output memory to receive a data 
amount equal to a sum of the audio/video data 
and the supplementary data and by providing 
the DMA processor with a link list so as to trans- 
fer the audio/video data and supplementary da- 
ta to the output memory according to the link 
list. 

2. An apparatus according to claim 1 wherein the sup- 
plementary data includes index data for the audio/ 
video data. 

3. An apparatus according to claim 2 further including 
an input for an MPEG stream containing said audio/ 
video data and index data and means for parsing 
the MPEG stream and storing the audio/video data 
in the first memory and the supplementary data in 
the second memory. 

4. An apparatus according to claim 1 , 2 or 3 further 
including an interrupt for causing the controller to 
initiate the DMA process when either of the first and 
second input memories contain a respective prede- 
termined amount of data. 

5. An apparatus according to any preceding claim 
wherein the supplementary data includes meta data 



for the audio/video data. 

6. An apparatus according to claim 5 wherein the meta 
data is at least one of sub titles, supplementary in- 

5 formation about the content of the audio/video data, 
supplementary audio data. 

7. An apparatus according to any preceding claim fur- 
ther including a third input memory for storing ap- 

10 plication data for applications related to the audio/ 
video data wherein the controller initiates the DMA 
process by instructing the output memory to receive 
a data amount equal to a sum of the audio/video 
data, the supplementary data and at least a portion 
is of the application data and by providing the DMA 
processor with a link list so as to transfer the audio/ 
video data, supplementary data and said at least a 
portion of the application data to the output memory 
according to the link list. 

20 

8. An apparatus according to claim 7 wherein, each 
time the controller initiates the DMA process, the 
controller instructs the output memory and provides 
a link list in respect of a different portion of the ap- 

25 plication data such that the application data is mul- 
tiplexed with consecutive amounts of audio/video 
and supplementary data from the first and second 
memories. 

30 9. An apparatus according to any preceding claim 
wherein the output memory has large seek times, 
but fast continuous access times. 

10. An apparatus according to claim 9 wherein the out- 
35 put memory is a hard disk drive. 

1 1 . An apparatus according to any preceding claim em- 
bodied in one of an integrated television device, a 
set top box for a television and a stand alone video 

40 recorder. 

12. A method of multiplexing audio/video data of a first 
input memory with supplementary data of a second 
input memory using a DMA processor, the method 

45 including: 

providing the DMA processor with a link list for 
the audio/video data and the supplementary 
data; 

50 providing an output memory with instructions to 

receive a data amount equal to the combination 
of audio/video data and supplementary data; 
and 

instructing the DMA processor to carry out a 
55 DMA process to the output memory on the ba- 

sis of the link list. 
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Fig.7(a) 
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Fig.7(b) 
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Fig.7(c) 
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